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Abstract 

We consider a communication system in which status updates arrive at a source node, and should be transmitted 
through a network to the intended destination node. The status updates are samples of a random process under 
observation, transmitted as packets, which also contain the time stamp to identify when the sample was generated. 
The age of the information available to the destination node is the time elapsed since the last received update 
was generated. In this paper, we model the source-destination link using queuing theory, and we assume that the 
time it takes to successfully transmit a packet to the destination is an exponentially distributed service time. We 
analyze the age of information in the case that the source node has the capability to manage the arriving samples, 
possibly discarding packets in order to avoid wasting network resources with the transmission of stale information. 
In addition to characterizing the average age, we propose a new metric, called peak age, which provides information 
about the maximum value of the age, achieved immediately before receiving an update. 

Index Terms 

Age of information, queuing analysis, random processes, communication networks 


I. Introduction 

Numerous applications of communication networks require the transmission of information about the 
state of a process of interest between a source and a destination. This is the case, for example, in 
sensor networks, where sensor nodes report the observations to a central processor, to monitor health 
or environment conditions m, m- Another example is the use of a feedback channel to report side 
information in communication networks [|3||, JH. In these applications, the timeliness of the transmitted 
message is an important and often critical objective, since an outdated message may lose its value. Hence, 
a theory of age of information is useful to optimize communication systems when the receiver has interest 
in fresh information. This work is a contribution to the initial efforts in this direction. 

We focus on applications of communication networks in which a random process is observed, and 
samples are made available to a source node at random times. The samples are transmitted in order to 
update the value of the process known at the destination node. For that reason, the transmitted messages 
are also called status updates. 

Status updates are transmitted as packets, containing information about one or more variables of interest, 
and the time of generation of the sample. Typically, it takes a random time until the packet is successfully 
delivered through the network. If the most recently received update carries the time stamp U{t), which 
characterizes the instant of generation of the update, then the status update age, or simply age, is defined 
as the random process A(f) = t — U{t) IIH. Hence, the age is the time elapsed since the last received 
packet was generated. 

In this work, we model the source-destination link as a single-server queue, and consider a particular 
aspect in the transmission of status updates, namely the packet management at the source node. We assume 
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that the source receives random updates, but some of the packets may be discarded even before being 
transmitted through the network. Part of the results have been presented in 0. 

We consider three policies for packet management: (i) discard every packet that finds the server busy, 
(i7) keep a single packet waiting for transmission, and discard any additional packets that find the system 
full upon arrival, and (in) keep a single packet waiting for transmission, replacing it upon arrival of a 
more up-to-date packet. 

The average age is calculated for each of the three policies, and we compare the results with a scheme 
without packet management. One remark is that the packet management policies are adequate if the 
objective is to inform the destination about the most recent value of the process of interest, as we do not 
consider any cost associated with discarding samples. There may be applications where the availability 
of multiple consecutive samples is also desirable, even at the cost of a larger associated age, for example, 
if an estimation is performed at the destination node. This interesting trade-off is out of the scope of this 
paper. 

In addition to the analysis of the average age, we propose a new metric, called peak age, which provides 
information about the maximum value of age achieved immediately prior the reception of an update. The 
peak age can be used to characterize the timeliness of information transmitted through a network, instead 
of the average age, with the advantage of a more simple formulation, and a complete description of its 
probability distribution. Another motivation to define the peak age is its relationship with the probability 
that the age exceeds a threshold, which is relevant to design systems with a guarantee that the information 
available at the destination is fresh at any given time. 

A. Related Work 

The age of information was formalized as a metric of interest in the context of vehicular ad-hoc networks 
in Q and [[HI. In [|71, the authors address the problem of congestion control in large vehicular networks, 
proposing a rate control algorithm to minimize the age of information throughout the system. The effect 
of piggybacking messages throughout the vehicular network was investigated in ||8l, and shown to be 
effective in reducing the age of information. 

Simple network models based on queuing theory have been used in Q, ||9l, and [[TOl . aiming to 
understand more fundamental characteristics of the process describing the age of information. The av¬ 
erage age has been investigated in ||51, considering randomly generated samples arriving according to 
a Poisson process, transmitted between a single source-destination pair, using a first-come-first-served 
(FCFS) discipline. With the simplifying assumption that the time it takes for a sample to be transmitted 
is exponentially distributed, and assuming that all samples wait in a queue for transmission, the authors 
model the system as an M/M/1 queue. The average age for the M/D/1 and D/M/1 models is also calculated 
in [|5]|, illustrating the cases with deterministic service time and periodic sampling, respectively. The case 
with multiple sources was studied in 10 • The main result is that optimizing the system for timely updates 
is not the same as maximizing throughput, nor it is the same as minimizing delay. The work in IITOl 
is more closely related to ours. The authors have analyzed the case with last-come-first-served (LCFS) 
queue discipline, and have shown that this transmission discipline achieves a lower bound for the average 
age when the arrival rate is very large. In this work, we show that the same lower bound can be achieved 
with first-come-first-served (FCFS) discipline and packet management policies. 

The transmission of status updates through a network cloud was investigated in IfTTl . where the authors 
calculate the average age, considering that all packets are transmitted immediately after generation, 
and some packets are rendered obsolete, due to the random service times in the network. This model 
corresponds to the extreme case of an infinite number of servers, and it presents a case in which resources 
are wasted transmitting all the available samples. In [fT^ . the authors discuss the case with only two 
servers, accounting for both the effect of queuing and the possibility that packets are received out of 
order, wasting network resources. The packet management schemes proposed in this work prevent the 
transmission of outdated messages and the consequential waste of network resources. 
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Figure 1. Transmission of status updates through queuing system. 


B. Organization 

The formal definition of age of information, the proposed packet management policies, and the corre¬ 
sponding system models are described in section [III In section [IIIl we describe the two metrics for age 
of information investigated in this paper, namely the average age and the peak age. The analytic results 
for average age and peak age are discussed in section |IVl in subsections dedicated to each of the three 
packet management schemes. Numerical results are presented in section |Vl and final remarks in section 
lYB 


II. Problem Statement and System Model 

Consider a communication link with one source-destination pair. A random process H{t) is observed, 
and the status of this process is available to the source node at random time instants. The destination node 
has interest in timely information about the status of the process H{t), but this information is not available 
instantaneously, since it has to be transmitted from the source through a link with limited resources. The 
source node obtains samples of the random process of interest H{t), and transmits status updates in the 
form of packets, containing the information about the status of the process, and the time instant that the 
sample was generated. We denote the time stamps with tk, and each status update message contains the 
information {H{tk),tk}. 

The transmission of status update messages will be studied using queuing theory, and we illustrate the 
system in Figure [B We represent the random process of interest H{t), which is observed in different 
time instants k = 1,2,.... Each observation becomes immediately available to the source node as a 
packet containing {H{tk),tk}. Hence, tk is also regarded as the arrival time of the packet to the source 
node. The arrival process is modeled as a Poisson process of rate A, and each packet may be stored in 
a finite capacity buffer, if space is available, or discarded according to the packet management scheme. 
The transmission of a packet takes a random amount of time, which depends on channel conditions such 
as fading, and network conditions such as congestion. As a simplifying assumption, we consider that 
the time for transmission of a packet is exponentially distributed, with mean 1/p. The adopted queue 
models have a single server, and packets are transmitted using a first-come-first-served (FCFS) policy. In 
the destination, we are interested in characterizing the timeliness of the information available about the 
process H{t). 

The timeliness of the information about the process of interest can be characterized by the age of 
information [l5]|, which we define below. 

Definition 1: Age of Information 

Fet H{f) be a random process of interest. Fet status update messages be packets containing the 
information {H{tk),tk], k = 1,2,..., to be transmitted in a source-destination link. Denote with tf 
the corresponding time instants at which the status update messages arrive at the destination. 

At a time instant s, we define the index of the most recently received update 

N{s) := max{fc|f'fc < s}, 


(1) 
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and define the time stamp of the most recently received update 

f/(s) := t7V(s). (2) 

Finally, we define the age of information as the random process 

A{s)-.= s-U{s). (3) 

As mentioned in section iFAl the characterization of average age for status update systems using queuing 
theory has been considered before, but most previous work assumed the transmission of all generated 
packets. In this work, we consider that the source node can discard some of the arriving packets, in a 
process that is referred to as packet management. We compare three policies of packet management: 

(i) assume that samples which arrive while a packet is being transmitted are discarded, and the ones that 
find the source node idle are immediately transmitted to the destination. In this case, no packets are kept 
in a queue waiting for transmission. Assuming a Poisson arrival process, FCFS policy, and exponentially 
distributed service time, this scheme is modeled as an M/M/1/1 queue, where the last entry in the Kendall 
notation refers to the total capacity of the queuing system, which is a single packet in service; 

(i7) assume that a single packet may be kept in queue, waiting for transmission if the server is busy 
transmitting another packet. If the server is idle, the service starts immediately. Under the assumptions of 
Poisson arrivals, and exponential service times, this second model of packet management can be studied 
as an M/M/1/2 queue. Here the total capacity of the queuing system is one packet in service and one 
packet in queue; 

(ill) The third packet management policy also assumes that a single packet may be kept in the buffer 
waiting for transmission. We propose that packets waiting for transmission are replaced upon arrival of a 
more up-to-date packet. Keeping the other assumptions, we can model this proposed system as a modified 
M/M/1/2 queue, identified as an M/M/1/2* queue. This is a peculiar queuing model, for which some of 
the classic results from queuing theory, such as Little’s result [[T3l Chapter 2], fail to apply. 

In order to understand more about the process A(/), defined in ([3]), we depict in Figure examples of 
sample paths for each of the models described in (i)-(iii). The age of information at the destination node 
increases linearly with time. Upon reception of a new status update, the age is reset to the difference of 
the current time instant and the time stamp of the received update. Recall that tk denotes the time instant 
the kth packet was generated, and tf the time instant that this packet completes service. We identify with 
Tfc the time spent in the system, defined as 

Tk ■ t k tki 

and let the interdeparture time be denoted with Yk, defined as 

Tk • t k / fc—!• 

Figure [2(a)] illustrates the case (i) of an M/M/1/1 queue, and the packets arriving at times /* and /** are 
discarded, since the server was found busy upon arrival. A sample path example for the case (ii) is shown 
in Figure |2(b)[ which considers an M/M/1/2 queue model. In this model, there is a single buffer space, 
and packets that find the server busy and the buffer occupied are discarded, as illustrated for a packet 
arriving at time /*. Figure [2(c)] presents an example of the evolution of age with the policy described in 
item (ill), modeled as an M/M/1/2* queue. No packets are blocked from entering the queue. If a new 
packet arrives while the system is full, the packet waiting is discarded. In the illustration, the packet that 
arrived at time /* spends some time in the buffer, but it is substituted when a new packet arrives at time 
t^. The transmission of this last packet begins when the server becomes available, at time t' 3 . 

Notation: the subindex k will be used to refer to successfully transmitted packets only. We will not 
identify the time of arrival of discarded packets. As an example, consider the sample path illustrated in 
Figure |2(a)[ The fourth and fifth packets to arrive are discarded. In this case, the fourth transmitted packet 
was the sixth packet to arrive, but we use index fc = 4, arrival time and departure time t\. We identify 
the fourth peak with A4, and the area of the fourth trapezoid with Q4. In general we will write Ak, Qk, 
Yk, Tk to refer to quantities associated with the kth transmitted packet. 
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(b) Sample path with M/M/1/2 model 



T 4 ^5 


(c) Sample path with M/M/1/2* model 


Figure 2. Sawtooth curve - Examples of sample path for age A{t). We identify examples of the time in the system Tk, the interdeparture 
time Yk, the peaks Ak, and the areas of geometric forms Qk, which will he used in the characterization of the age throughout this paper. 
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III. Metrics for Age of Information 

After observing the sawtooth curves in Figure [2l we present in this section two metrics that can be 
used to characterize the age of information, namely the average age and the peak age. 


A. Average Age 

Assuming ergodicity of the process A(f), the average age can be calculated using a time average. 
Consider an observation interval (0,r). The time average age is 

A^ = -[ A(t)dt. (4) 

-r Jo 

The integration in dH) can be interpreted as the area under the curve for A(f). Observing Figure 
note that the area can be calculated as the sum of disjoint geometric parts with areas identified by Qk, 
k = 1,2,.. .N{t), with N{t) as defined in ([T]). In the case that r > t' n{t), there will also be a partial 
area to be added in the end, which we will denote with Q. Summing all the areas, we write the time 
average age as 

A,= 


The average age is calculated as 


N{r) 


— I Qi + Q + Qk 


k=2 


Qi + Q ^~ 1 


N{t) 


T N{t) — 1 


_ ^ Qk- 


(5) 


k=2 


we take the length of the observation interval to infinity 


A = lim A,-. 

r—>-CO 


( 6 ) 


The ratio of the number of transmitted packets by the length of the interval converges to the rate of 
transmitted packets, referred to as the effective arrival rate. We define 
Definition 2: Effective Arrival Rate 


Ae := 



(7) 


r^oo 7" 


Also, as r —)■ cx), the number of transmitted packets grows to infinity, A(r) —>■ cx). Due to the ergodicity 
of Qk, the average age can be calculated as 


A — AeE[Qfc] 


( 8 ) 


To calculate the area, Qk, we take the area of the bigger isosceles triangle with sides Tk-i + Yk, and 
subtract the area of the smaller triangle with sides T^. The average area is 

E|Q,] = iE|(n_,+ Ytf] - 

= iE|K-!] + E|T,_in|, 

where the second equality follows from the fact that Tk-i and Tk are identically distributed. 


(9) 
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B. Peak Age 


Depending on the application, it may be necessary to characterize the maximum value of the age of 
information, immediately before an update is received. It may also be desirable to optimize the system 
so that the age remains below a threshold with a certain probability. 

With that motivation, we propose an alternative metric to the average age, obtained observing the peak 
values in the sawtooth curve. The peak age provides information about the worst case age, and its expected 
value can be easily calculated in many cases of interest. 

Observe the example sample paths shown in Figure [U Consider the peak corresponding to the kth 
successfully received packet. The value of age in the peak is denoted with A^. We present the definition 
of peak age below. 

Definition 3: Peak Age 

Let Tk-i be the time in the system for the previously transmitted packet, and Yk be the interdeparture 
time, or the time elapsed between service completion of the {k — l)th packet and service completion of 
the kth packet. The value of age achieved immediately before receiving the kth update is called peak age, 
and defined as 


Ak ■— Tk-i + Yk- 


( 10 ) 


IV. Characterizing Average Age and Peak Age for Selected Queuing Models 

In this section we characterize the average age and the peak age for each of the three queuing models 
mentioned in (i)-(iii). We start with a discussion about the interdependence between the variables Tk-i 
and Yk. For the peak age we are interested in the distribution of their sum, while for the calculations of 
the average age, we need to obtain the expected values in dH). 

Using queuing system models, we are able to characterize both the time in the system and the 
interdeparture times but, in general, these two random variables are not independent and we do not 
have information about the joint distribution. Nonetheless, it is possible to describe an event such that 
Tk-i and Yk are conditionally independent. 

Let be the event that a packet left behind an empty system upon departure. Under the assumption of 
Poisson arrivals, the time until the next arrival is exponentially distributed with parameter A, due to the 
memory less property of interarrival times. The arriving packet will be served immediately, and the service 
time is assumed to be exponentially distributed with parameter p. The interarrival and service times are 
independent, and they are also independent from the time in the system of the packet that just left. 

We denote with xjj the complement event that the system is not empty upon departure, i.e. there was 
at least one packet waiting in queue. In this case, the packet waiting in queue starts service immediately, 
and the time until the next departure is simply a service time, which is independent of the time in the 
system for the packet previously served. 

For queuing systems with single, as opposed to batch, arrivals, the probability of leaving the system 
empty upon departure is equal to the steady state probability that the system is empty |[T4l Chapter 5]. The 
steady state distribution is particular to each queuing model, and will be presented later in this section. 

The variables Tk-i and Yk are conditionally independent, given the event that the {k — l)th packet 
leaves behind an empty system upon departure. While the conditional distribution of the time in the system 
depends on the selected queuing model, the conditional distribution of the interdeparture time can already 
be stated here. It is given by the convolution of the distributions of two exponential random variables, 
with parameters A and p, which yields 


fm) = -f-T [e-’-" - e-™] . 

I~L /\ 

= — H , 

A p 


( 11 ) 


(12) 
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(13) 

(14) 

(15) 

(16) 

calculated later in this section for 

nn-iYk] = P(^)E[Tfc_in|V'] + P(^)E[Tfc_in|^] 

= P(V^) (E[Tfc_i|^]E[m^]) + P(^) (E[Tfc_i|^]E[n|^]) (17) 

For each queuing model investigated in this paper, we will describe the probability distribution of the 
peak age by first conditioning on the event 'll:- The conditional probability density function is then obtained 
as the convolution of the conditional density functions for Tk-i and Yk, which we represent as 

fial'fp) = fitl'fp)* (18) 

Similarly, we obtain the conditional distribution given the event T/i, and then write the probability 
distribution of the peak age using 

f{a) = F{'il))f{a\i))+ F{^j})f{a\^j}). (19) 

In what follows, each subsection describes in detail the calculations of average age and peak age for 
the selected queuing models, namely the M/M/1/1, M/M/1/2, and M/M/1/2* models. For each model, we 
need to describe the steady state distribution of the number of packets in the system, in order to calculate 
P(t/'). We also need to characterize the distribution of the time in the system, in order to calculate the 
expectation in (fTTI) and the distribution of the peak age. 


nyM = 


2(A^ + A/i + p?) 

AV ' 


We also have that 


/(//IV’) = /^exp(-/i?/). 

iE[niV] = 

/X 

E|n" i«] = 

The expectation of the product, E[Tfc_iYfc], to be used in (|9l), will be 
each of the queuing models, using nested expectations, as 


A. M/M/1/1 Queue 

1) Preliminary Calculations: An M/M/1/1 queue can be described using a two-state Markov chain, 
with each state representing the server as idle or busy. We denote with po the probability of an empty 
system, and pi is the probability of one packet in the system. Analyzing the two-state Markov chain, it 
is straightforward to obtain [|T3l Chapter 3] 


Po = 


A -f /i 


; Pi = 


A 

A -f /X 


( 20 ) 


In the case of an M/M/1/1 queue, a packet is accepted in the system only if the server is idle. The 
effective arrival rate will be denoted with Ag, and we have Ag = A(1 — pi). The time in the system for 
transmitted packets is equal to the service time, which is assumed to be exponentially distributed with 
mean 1/p. The average number of packets in the system is E[A^] = Opo + Ipi- 
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2) Average Age: Recall that -0 represents the event that a transmitted packet left behind an empty 
system upon departure. In the M/M/1/1 model, this is a certain event, since there is only one packet at 
a time in the system. In this model, the time in the system for transmitted packets is independent of the 
interdeparture time. Using this fact in (|9l), together with (fT^ and (fT3l) . the average age for the M/M/1/1 
model is calculated as 


Mil II — AelE[<5fc] 

= Ae QE[(n)2] + E[Tfc_i]E[n]^ 
Xfi 

A + /i 

_ 1 2 1 
A /i X fjj 


A + /i 
A/i 


1 ^ 1 A + /r 
A/r Xfi 


The limit as the arrival rate goes to infinity is 


lim Am/m/ 1/1 — —, 

A —>-oo yj, 


( 21 ) 


( 22 ) 


which is equal to the lower bound for the average age among all first-come-first-served (FCFS) systems 
with a single server ifTOl . In other words, regarding the average age, this scheme is asymptotically optimal 
in this class of models. 

3) Peak Age: For the peak age, the probability density function is given by the convolution of an 
exponential distribution for the service time with the distribution of the interdeparture times shown in 
(HU). As a result, we have 


/(a)M/M/i/i = /(a|0) 

= /(^|0) * /(//|0) 




(A, 


—Xa 


Xe-^^ + A(A - /i)ae-'^“) 


, ... , , (23) 

X — jjL ^ 

The complementary cumulative distribution function, which describes the probability that the peak age 
surpasses a threshold, is described as 


P(A > a)MiMiiii — 


/i 


X — fi 


e-^“ + 


1 - 




X — fi 




A/1 

A — /i 


ae 


—^a 


(24) 


The average peak age for the M/M/1/1 model can be obtained integrating (1241) . It can also be calculated 
easily, observing that E[Tfc_i] = 1 /p, while E[lfc] = E[Yfc|0], as in (fT2l) . As a result. 


111 
m/m/1/1 — —I" T — 

p A p 
1 2 
— T 3—• 

A p 


(25) 


B. M/M/1/2 Queue 


1) Preliminary Calculations: The M/M/1/2 queue can be described by a Markov chain with three 
states, that represent an empty system, a single packet being served, or a packet in service with a packet 
waiting in the buffer. Let p := X/p. The analysis of the three-state Markov chain yields the steady state 
probabilities [HSl Chapter 3] 


Pi 


!>> 


1 + p + ’ 


je {0,1,2}. 


(26) 
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Once we have the steady state distribution, we ean ealeulate P('0)7 whieh is equal to the steady state 
probability that the system is empty lfT4l Chapter 5]. We normalize the probabilities and write 


P(^) 

P(^) 


Po 

Po+Pi 

Pi 

Po+Pl 


p 

A + /i 
A 

A + /r 


(27) 

(28) 


A paeket is aeeepted in the system as long as the system is not full. Therefore, the effective arrival rate 
is Ae = A (1 -pa)- 

We ean already ealeulate the first term of 'E[Qk\ using (flSl) . (fT^ . together with (1271) and (1281) . and we 
have 


iEK] = i (EK|^]P(^) + EK|^|P(^)) 

_ 1 / 2(A^ + Ap + p^) p 2 A A 
2\ (A/i)^ A + /i~^/r2A + /ry 

1 1 


(29) 


Next we need to eharacterize the time in the system for the transmitted paekets, and also its eonditional 
distribution, given the event i/j. The time in the system can be written as Tk-i = Wk-i + Sk-i, where 
Wk-i is a random variable representing the waiting time, and Sk-i represents the serviee time. 

The waiting time is zero if the system is found idle upon arrival. Due to the PASTA property (Poisson 
Arrivals See Time Averages) lfT4l Chapter 3], the probability that the system is found idle upon arrival 
is equal to the steady state probability that the system is idle. If the system is found busy upon arrival, 
the waiting time is the remaining serviee time, whieh is exponentially distributed with parameter /r, due 
to the memory less property of service times. Note that the waiting time is independent of future arrivals, 
hence independent of the event ip. For the waiting time of a transmitted packet, we have 


F(Wk-i >w)= e~^^, w > 0. (30) 

Po+Pi 

The average waiting time can be obtained integrating (l30l) . or using Little’s result [fT3l Chapter 2] 
applied to the average number of paekets in the buffer, E[A’q] = lp 2 , and using the effeetive arrival rate, 
which yields 


E[iyfe_i] 


E[iV,] 

Ae 

lP2 

A (1 -pa) 

A 

/i(A + p) 


(31) 


For the time in the system, we ean eondition on the state found upon arrival (idle or busy), separating 
the cases with and without waiting. For transmitted paekets we have 

P(Tfc_i >t) = -^^F{Sk-i > f|idle) + + IL^.i > f|busy) 

Po +Pi Po+ Pi 

= + yA-c-"' (1 + . (32) 

A + /i A + /i 

where the seeond equality follows from the faet that, given that the server was found busy upon arrival, 
Wk-i and Sk-i are two independent random variables, each exponentially distributed with parameter /i. 

The average time in the system ean be calculated integrating the result in (l32l) . It is also straightforward 
to obtain the average time in the system using (l3TI) and adding the average serviee time. Alternatively, 
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it can be calculated using Little’s result with the average total number of packets in the system, E[iV] = 
Opo + Ipi + 2p2, and the effective arrival rate, which yields 


E[Tfc_i] 


p + 2A 
/i(A + /i) 


(33) 


We also need the conditional distribution fitl'ip) of the time in the system given the event '0- We note 
that the {k — l)th transmitted packet leaves the system idle upon departure if and only if zero arrivals 
occur while the {k — l)th transmitted packet is being served. Let f{s) be the probability density function 
of the service time. We define the probability P('i/i|S'fc_i = s) by requiring that for every measurable set 
A c [0, oo), we have 

P(V^, Sk -1 eA)= [ f{s)F{i:\Sk-i = s)ds. (34) 

Ja 

The conditional distribution of service time, given that no arrivals occur is calculated as 


fisl'ip) 


P(Vi|5'fc-i = s)f{s) 
/“P(V'|^fc-i = s)f{s)ds 


(A^)° 

0 ! 




(A + /i)e-(^+^)*, 


(35) 


with the conditional expectation 

E|Si_i|V.] = 

A + /i 


(36) 


For the conditional distribution of the time in the system, we use the results in (l30l) and (1351) to write 


P(Tfc-i 


> m = F{Wk-i + Sk-i > m 



> t — s)/(s|V’)ds 


(37) 

(38) 

(39) 


with conditional expectation 

Wk-AM = -■ (40) 

/i 

We follow similar steps conditioning on the complement event The system is left behind with another 
packet waiting for transmission if and only if at least one arrival occurs during the service time of the 
(/c — l)th transmitted packet. The conditional distribution of the service time given the event Ajj is calculated 
similarly to (1351) and yields 




P(^|^fe_l = s)f{s) 
/“P(V’|^fc-i = s)f{s)ds 

(^1 - 

ir 

(1 - e-^") 


with the resulting conditional expectation 


E[5fc_i|^] 


1 1 
/i (A + /i) 


(41) 


(42) 
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For the time in the system, we write 


P(Tfc_i > tli/j) 


p(PFfc_i + Sk-i > m 


P(PFfc_i > t - s)f{s\'ilj)ds 


e ^*(1 + fit), 


(43) 


indieating that the probability distribution in this case is the result of a convolution of two exponential 
distributions with parameter jj,. The conditional expectation is 


E[TkS] = (44) 

/i 

2) Average Age: Using the probabilities for the events ip and pj as described in (1271) . and (l28l) . together 
with the conditional expectations calculated in (fT^ . and (fT5l) for Y^, and in (l40l) and (l44l) for T^-i we can 
finally calculate the expected value of the product Tk-iYk, to be used in the calculations of the average 
age. We have 


nTk-iYk] = ^Tk-lYk\^/J]F{^/J) + E[Tk-iYk\i>]F{^) 

^ I 

yA fl J fl X -\- fl fJ. jJ. X -\- jJ. 

2A^ “h A/i “h 

\fY{\ + fi) 

We write the average age for the M/M/1/2 model using (l29l) and (l45l) as 


(45) 


^MIMIll2 — AeE[Qfc] 

= Ae QE[(n)2] + E[Tfc_in]^ 

A/i(A +/i) /I 1 2A^ + A/x + /i^A 

A^ + A/x + \A^ A/i^(A + /i) / 

1 , 3 2(A + /x) 

^ A + ■ vTvTiV ’ 

The limit as the arrival rate goes to infinity is 

3 

lim Am/ax/ 1/2 = —, (47) 

A—>-cx) jjj 

which is much larger than the case modeled as M/M/1/1. Intuitively, for very large arrival rates, keeping 
a packet in the buffer is not advantageous, because the information ages while waiting in queue, and it is 
better to wait for a new packet to arrive instead of keeping one in the buffer. 

3) Peak Age: The probability distribution of the peak age is calculated conditioning on the events xp 
and Ip. In this case, Tk-i and Yk are conditionally independent random variables, and the distribution 
of their sum can be obtained using the convolution of their individual conditional probability density 
functions. Using the probability distributions described in (fTTI) . (fT4l) . (I39l) . and (1431) . we finally obtain 

f{a\P:)M/M/i/2 = (x^) “ /^)«e-^“) (48) 

fia\pj) m/m/1/2 = (49) 
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and the distribution of the peak age is the mixture, as deseribed in (fT9l) . using the probabilities in (1271) 
and (l28l) . 

The eomplementary eumulative distribution funetion whieh deseribes the probability that the peak age 
surpasses a threshold is 

P(-4 > 

''' 2(A - 2A;i(A - fi)a + 2(A^ - A;i - fi‘)] (50) 


The expected value of the peak age can be calculated directly as 


E[Tfe_i] 


E[n] 


E[24fc]jvr/M/i/2 


p + 2X 

/i(A + p) 

1 A 

A pi^X T /i) 

E[Tfc_i] + E[n] 

1 3 2 

-r H-T- 

A fl A fJj 


(51) 


C. M/M/1/2* Queue 

1) Preliminary Calculations: The M/M/1/2* is a peculiar queue model, in which the packet waiting 
in queue is replaced if a new packet arrives. Regarding the number of packets in the system, this model 
behaves exactly as the M/M/1/2 queue. That is because a replacement only occurs when an arriving packet 
finds the system full, so the replacement results in a packet being discarded. Intuitively, discarding the 
packet that just arrived or the packet that was already in the buffer does not change the number of packets 
in the system. As a result, the M/M/1/2* queue can be described with a three-state Markov chain, and 
the steady state probabilities in (|2^ still hold. The average total number of packets in the system is 
E[A^] = Opo + Ipi + 2p2, and the effective arrival rate is Ae = (1 — P 2 )X, as in the M/M/1/2 model. 

The first term in the calculation of E[(5fc] , which is E[Y’^^]/2 also remains the same as calculated in 
(l29b for the M/M/1/2 model. 

It remains to characterize the time in the system for transmitted packets. In the M/M/I/2* model, some 
packets leave the system after spending some time waiting in the buffer, while other packets end up being 
transmitted. As a result, Little’s result fails to apply to the packets in the buffer. In order to characterize 
the time in the system for transmitted packets, let T (without any index) be the time in the system for any 
packet, which may or may not be discarded. Let P(T > /) describe the probability that a packet stays in 
the system for a time longer than t. Conditioning on the state of the server upon arrival (idle or busy), 
and on the event that the packet is transmitted (tx) or dropped (drop), we calculate 

P(T > /) = P(idle)P(T > /|idle) 

+P(busy, tx)P(T > /1 busy, tx) 

+P(busy, drop)P(T > /|busy, drop). (52) 

In what follows, we present the main arguments to calculate each term in (l52l) . 

An arriving packet finds the server idle with probability P(idle) = po, due to the PASTA property 
(Poisson Arrivals See Time Averages) [fT4l Chapter 3]. In this case, the packet is served immediately, and 
P(T > /1 idle) = 

A packet finds the server busy with probability P(busy) = 1 — po- According to the packet management 
scheme, it will be admitted in the system, but it will be transmitted if and only if no other arrival occurs 
while the service in progress is not completed. Let R represent a remaining service time, with probability 
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density function /(r), and let 0 be the event that no other packet arrives during the remaining service. 
We define the probability P((;/)|i? = r) by requiring that for every measurable set A C [0, cxd), we have 

F((/),ReA)= [ /(r)P(0|i? = r)dr. 

J A 

The probability of transmission, given that the server was busy upon arrival is calculated as 


As a result, 


P(tx|busy) 



= r)f{r)dr 



(Ar)° 

0 ! 




A + /i 


P(busy,tx) = (l-po)—^ 

A + /i 

P(busy,drop) = (1 -Po)ta— 

A + /i 


(53) 


(54) 

(55) 


The time in the system for a transmitted packet can be written as the sum of waiting and service 
times, T = W + S. Conditioned on the event {busy, tx}, the waiting time is distributed as the conditional 
distribution of the remaining service, given the event 0, calculated as 


/(w|busy, tx) 


P(0|i? = r)/(r) 
/“p(0|i? = r)f{r)dr 


(Ar)*^ —Ar — 

/xe 


0 ! 


-lir 


(A +/r)e-(^+^)A 


(56) 


Hence, conditioned on the event (busy, tx}, W is exponentially distributed with parameter (A + /r). 
The conditional probability density function of the time in the system is given by the convolution of 
the individual densities, since W and S are independent. The corresponding complementary cumulative 
distribution function we are looking for is 

P(T > t|busy, tx) = (57) 

A A 

If the packet finds the server busy and is dropped while waiting, the time it spends in the system is 
exactly the time until the next arrival, to be denoted with X, which is exponentially distributed with 
parameter A, conditioned on the event that the next arrival occurs before the end of the service in progress 
R. As a result, the conditional distribution can be calculated as 


P(T > t|busy, drop) = P(X > t\X < R) 

_ P(X >t,X <R) 

P(X < R) 

— e~^'^)iJ,e~^^dr 
~ /o°°(l - e-^^)^J,e-^^^dr 

= (58) 
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Finally, using the arguments above, we rewrite (l52l) as 

P(T > t) = poexp{—^t) 


+ (1 -Po) 
+ (1 -Po) 




From (l59l) . we also have 

P(T > t\tx) = 


X -\- fi 
X 

-( 

A + yU 


X fi _ 
X ^ 

— (A+//)t 


fit 


X 


(59) 


Po 


Po + {l-Po)j^ 
, i^-Po)j^ 




and the expeeted value 


Po + (1 -Po)]^ L 




A 


(60) 


(61) 


The expected value of the waiting time for a transmitted packet is calculated using (1561) to be 


E[iy|tx] = 




\-\-fl 


Po + (l—\A + /i 
A 


(A + a.)^' 

2) Average Age: The average age for the M/M/1/2* queue is calculated similarly to the M/M/1/2 
model. We write the conditional expectations for Tk-i using the equality Tk-i = Wk-i + Sk-i, with (l3^ 
and (l42l) for the expected service time, with expected waiting time for a transmitted packet is given in 
The resulting conditional expectations for Tk-i are 

E[Tfc_i|^] = E[lEfc_i|^] + E[Sk-i\ij] 

= E[Wk-i] + E[Sk-i\^/j] 

X 1 


(A + fiY 
2X + fi 

(aTTIF’ 


X -\- fi 


(63) 


E[Tfc_i|^] = E[Wk-i\^] + E[5fc_i|Vi] 


= E[W,_,]+E[Sk-M 


_ X 11 

(A + /i)2 /i (A + fi) 

_ 1 2X + fi 
/r ^ (A + /i)2‘ 

Using (1^ and (l64l) , together with the probabilities for the events ^jJ and x): as 
(1281) . and with the conditional expectations calculated in (IT^ . and ([T5]) for Y^, we 
of the product Tk-iYk, in the case of an M/M/1/2* model. 


(64) 

described in (l27l) . and 
obtain the expectation 


E[Tk-iYk] = E[Tfc_in|V']P(V’) + E[Tfc_in|^]P(^) 

_/l l\2A + yU fi 1/1 2X + fi\ X 

\A /rj {X + fi)'^ X + fi fi \fi {X + fi)'^) X + fi 

_ 1 1 _ 2A + /i 

/i^ Xfi (A + fi)^' 


(65) 
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We write the average age for the M/M/1/2* model using (l29l) and (1^ as 

/^M/M/l/2* = AeE[Qfc] 

= Ae QE[(n)2] + E[Tk-iYk]^ 

A/i(A + /i) /I 1 1 1 2 \ + fx\ 

A^ + A/i + /i^ \A^ /i^ AyU (A + yu)^/ 

= 1 2 A 1 _ 2(A + fi) 

A y(i (A + /r)^ A + /r A^ + Ayii + yii^ 

The limit as the arrival rate goes to infinity is 

2 

lim Am/m/ 1 / 2 * = —, (67) 

A—^oo 

indicating that the model with packet replacement behaves as the model without buffer (M/M/1/1) in the 
limit. Intuitively, as the arrival rate goes to infinity, a fresh packet will always be available for transmission 
in both models. The M/M/1/2* model is asymptotically optimal, as the M/M/1/1, but for finite arrival rates 
and a fixed service rate, the packet replacement provides better performance with respect to the average 
age, as will be illustrated in section |Vl 

3) Peak Age: We present the conditional distribution of the peak age, given the events -i// and -0. The 
probability density function is obtained as the convolution of the conditional distributions for T^-i and 
Yk, since these variables are conditionally independent. The distribution of the peak age is the mixture, 
as described in (fT9l) . using the probabilities in (1271) and (l28l) . 


Ml/^ ^ (2y(i^ - A^ - A» 

f{a\^)M/M/i/2* — I A(A + /r)a--) 

A/i + 2/i^ ^ A/i(A + /i) + A^ 

/i(A-/i) 




A — yU 


/(fl|V’)M/M/i/ 2 * — + 2A + A(A + p)a) 


( 68 ) 


(69) 


-^e-^“(3y(i + 2A - A(A + 2p)a) 

We also present the conditional complementary cumulative distribution, to describe the probability that 
the peak age surpasses a threshold. In the case of the M/M/1/2* model we have 


g-(A+/i)a 

P(y4fc > a)MiMiii2* = ~ + A/i(A + /r)(l + (A — p))) 

p fid 


A(A + /i)(A — /x) 


(3/x^ -|- A(A -|- /x)(A — /x) “|- A/x(x(A^ -I- A/x — 2^^)) 


Aa 


The average peak age can be obtained integrating the complementary cumulative distribution, or 
summing the expected values for Tk-i and Yk. As a final result, 

1 1 ^ 1 1 A 

E Afc m/m/ 1/2* — —h TT——^ + T —"TA—■ 

p (A + pY a p X + p 


(71) 
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Figure 3. Average age versus arrival rate (A) for the queuing models with packet management. Service rate /r = 1. 


V. Numerical Results 

In this section, we illustrate the results for average age and peak age with numerical examples. Unless 
otherwise stated, we assume unitary service rate (/r = 1). When /i = 1, and the x-axis has the arrival 
rate A, it can be regarded as the channel utilization p = X/p. In addition to the analytical formulations, 
some figures present simulation points, obtained from a discrete-event simulator that we have built in 
MATLAB. The simulation results are presented as circular markers in the curves, and corroborate the 
analytical results. 

Figure [3] illustrates the average age for the three queuing models with packet management. The packet 
replacement scheme yields the smallest average age. For example, when A = 0.6, packet replacement 
promotes a reduction of average age of approximately 5% in comparison to the other models. The average 
age is decreasing with the channel utilization inside the observed range 0<p< 1.5. 

Figure m provides a comparison of the average age with packet management modeled as an M/M/1/2* 
queue and the case without packet management, modeled as an M/M/1 queue, in which every packet that 
finds the server busy is stored in a buffer for later transmission. The average age for the M/M/1 model 
was presented in Q to be 

A _ 1 1 

— -r I r- 
A /i /i — A 

When A -C /i, the dominant effect is the large interarrival time and the two models have similar behavior 
because they are idle for a large fraction of time. As the arrival rate A increases, the dominant effect in 
the M/M/1 system is the queuing time which approaches infinity as the arrival rate approaches the service 
rate. As a result, the average age increases to infinity as the arrival rate approaches the service rate. This 
effect is eliminated with the packet management scheme, which promotes significant improvement in the 
average age, particularly for p > 0.5. 

Figure |5] shows the average age versus the service rate, with fixed arrival rate A = 0.5. In all cases the 
M/M/1/2* promotes the smallest average age, but the schemes have a common limit value as p goes to 
infinity, which is 1/A. That is, for very small service times, the average age is limited by the interarrival 
times. 

The complementary cumulative distribution function for the peak age is presented in Figure We 
consider a service rate p = 1, with arrival rates A = 0.5 and A = 1.3. The probability that the peak age is 
larger than a given threshold a can be reduced with larger arrival rates for all three schemes. Comparing 
the two groups of curves, we also note that the M/M/1/2* model produces the best peak age results for 
arrival rates below and above the service rate. The M/M/1/2 model presents the second best results for 
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Figure 4. Average age versus arrival rate (A) comparison with model without packet management. Service rate fj, = 1. 



Figure 5. Average age versus service rate (fj,) for the queuing models with packet management. Arrival rate A = 0.5. 


small arrival rates, but for large arrival rates the M/M/1/1 model performs better than the M/M/1/2 with 
respect to the peak age. 

Figure |7] illustrates the average peak age for the three queuing models. It corroborates the conclusion 
that keeping a packet in the buffer is preferable in the case of small arrival rates, while discarding all the 
packets that find the server busy could be adopted for very large arrival rates (A > p). The M/M/1/2* 
model with packet replacement presents the best results, and is the most adequate model for applications 
that require the age of information available to the receiver to be below a certain threshold. That is the 
case when the outdated information looses its value due to small correlation with the current state of the 
process under observation. 


VI. Final Remarks 

The concept of age of information is relevant to any system concerned with the timeliness of information. 
This is the case when an action is taken based on available information, but the information loses its value 
with time. The characterization of age of information is still incipient, and the investigation of simple 
models remains important to understand its impact on the performance of communication systems. 

This work provides contributions to the initial steps in the characterization of age in communication 
systems that transmit status update messages. We have considered that the source node can manage the 
samples of a process of interest, deciding to discard or to transmit status updates to the destination. 
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Figure 6. Peak age distribution: P(Afc > a) versus threshold a. Service rate /i = 1. Arrival rates A = 0.5 and A = 1.3. 
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Figure 7. Average peak age versus arrival rate (A) for the queuing models with packet management. Service rate fj, = 1. 


We observe that paekage management with paeket replaeement in the buffer promotes smaller average 
age, when eompared to sehemes without replaeement. The proposed seheme is asymptotieally optimal, 
aehieving a lower bound for average age while avoiding the waste of network resourees in the transmission 
of stale information. 

In addition to the average age, we proposed a new metrie, ealled peak age. The peak age is a suitable 
metrie to eharaeterize the age of information in applieations that impose a threshold on the value of 
age. The peak age has the advantage of a more simple mathematieal formulation, whieh will eertainly 
benefit future investigations regarding the optimization of a network with respect to the timeliness of the 
transmitted information. 
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